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Abstract 

We have measured the ZZ^ and Z77 couphngs by studying pp -^ Ipxl + X 
events at ^/s = 1.8 TeV with the D0 detector at the Fermilab Tevatron 
CoUider. This first study of hadronic Z7 production in the neutrino decay 
channel gives the most stringent hmits on anomalous couplings available. A 
fit to the transverse energy spectrum of the photon in the candidate event 
sample, based on a data set corresponding to an integrated luminosity of 
13.1 pb" , yields 95% CL limits on the anomalous CP-conserving ZZ7 cou- 
plings of l/ifol < 0.9, l/ifol < 0.21, for a form-factor scale A = 500 GeV. 
Combining these results with our previous measurement using Z ^ ee and 
11^1 yields the limits: |/ifo| < 0.8, l/ifol < 0.19 (A = 500 GeV) and |/ifo| < 0.4, 
|/ifol <0.06 (A = 750 GeV). 
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In the Standard Model (SM), couplings of the form ZV'-f, where V^ is a Z or 7, vanish 
at tree level. Direct measurement of the ZV'y couplings is made possible by studying Z7 
production. Previously, only the charged lepton decay modes of the Z have been studied in 
pp collisions at the Tevatron {^/s = 1.8 TeV) [||,H. Here we report the first measurement of 
Z'-f production in the invisible (neutrino) decay channel of the Z at a hadron collider; such 
studies have recently been made at LEP @,§]. This analysis of the neutrino decay channel 
significantly improves the limits on ZZ'j and Z77 trilinear couplings and, in combination 
with previous D0 limits from other decay channels p[, gives stringent new limits. 

We have studied the reaction pp —>■ J^rpj + X (where J^^ is missing transverse energy) 
using data from the 1992-1993 Tevatron run with the D0 detector, corresponding to an 
exposure of 13.1 ± 0.7 pb^ . The advantages of using the Z ^ uu mode compared with 
the i~^i~ decay channels are larger geometrical acceptance and detection efficiency; higher 
branching ratio (by a factor of six over ee or fifi); and absence of the radiative Z-decay 
contribution. However, the invisible decay mode of the Z does not allow reconstruction of 
the Z mass and has larger potential background. 

The D0 detector, described in detail elsewhere [Q, consists of three main systems. Cen- 
tral and forward drift chambers are used to identify charged tracks for |?7| < 3.2, where 77 is 
pseudorapidity. The calorimeter consists of uranium-liquid argon sampling detectors with 
fine segmentation in a central and two end cryostats, and provides near-hermetic coverage 
for \ri\ < 4.4. The energy resolution of the calorimeter was measured in beam tests to be 
15%/ yE for electrons and 50%/ v^ for isolated pions {E in GeV). The calorimeter towers 
subtend 0.1 x 0.1 in r^ x (0 is the azimuthal angle), segmented longitudinally into four 
electromagnetic (EM) and four or five hadronic layers. In the third EM layer, at the EM 
shower maximum, the cells are 0.05 x 0.05 in r^ x 0. The muon system consists of magne- 
tized iron toroids with one inner and two outer layers of drift tubes, providing coverage for 
\ri\ < 3.3. For this analysis the muon detector was used only as a veto. 

Z'-f candidates were selected by requiring a significant amount of ^j' and an isolated 
photon with high transverse energy (E^). There are three major sources of background to 
j/^xl production: 1) jet- (j) related background from jj and J7 production, occurring when 
a jet hits a poorly instrumented region of the detector resulting in mismeasured ^y. In 
the dijet case, one jet additionally has to be reconstructed as a photon when fragmenting 
into a leading neutral meson; 2) cosmic ray or beam halo muon bremsstrahlung in the EM 
calorimeter which results in a reconstructed single photon in the event with balancing missing 
energy; 3) W boson production (with W — > eu), where the electron is reconstructed as a 
photon due to inefficiency of the tracking chambers. Other backgrounds, such as Wl^u) +j 
or Zluu) + j production with a jet faking a photon (and an unreconstructed or forward 
muon for the W case) are negligible. 

The J/^rp'j sample was obtained with a trigger which required an isolated EM cluster 
with Ex > 20 GeV. A photon cluster was required to be within the fiducial region of the 
calorimeter and tracking chambers (|?7| < 1.0 in the central calorimeter (CC) or 1.5 < 
\ri\ < 2.5 in the end calorimeters (EC)). The offline photon identification requirements 
were: («) EM energy > 0.96 times the total shower energy; (n) lateral and longitudinal 
shower shape consistent with that of an electron shower |^; {Hi) the isolation variable of 
the cluster < 0.1; (iv) a photon cluster with no evidence of associated tracks or hits in 
the drift chambers; {v) development of the photon shower in the EM calorimeter consistent 



with its origin at the interaction vertex reconstructed by the tracking chambers; (vi) no 
muon tracks in the central calorimeter near the photon; (vii) no additional EM clusters in 
the event with Et > 5 GeV; and (viii) E^ > 40 GeV. 

Missing energy was calculated using the calorimeter energy deposits. The hadronic 
calorimeter energy scale was determined by minimizing the average ^^ in inclusive Z —>■ ee 
events. The resolution of the missing transverse energy projected on a given axis was 
~ 6 GeV and depended slightly on the boost of the Z7 system. We required J^^ to exceed 
40 GeV. We also required no reconstructed muons in the central region of the detector 
{\ri^\ < 1.0) and no additional hadronic jets in the event with transverse energies above 
15 GeV. 

This selection resulted in four Z{vv)'-j candidates. Three events had a photon in the CC 
and one in the EC. The highest photon Et in this sample was 68 GeV. 

To estimate the number of surviving jet-related background events, we first determined 
the probability to mismeasure $rp in the detector by comparing the numbers of ^^j and jj 
events collected in the same data set. This probability falls exponentially with I^j^ and is 
< 10^^ for ^j. > 35 GeV. The probability for a jet to fake a photon was measured PJTl 



to be (7 ± 2) X 10~ . These probabilities were applied to the J7 + X cross section and 
jj + X cross section (calculated from data) with a minimum transverse energy cut of 40 
GeV imposed on jets and photons. The total background from these sources was estimated 
to be < 0.6 events. 

The muon bremsstrahlung background was significantly suppressed by the photon quality 
criteria (w) and {vi)^ as well as by the high Ej^ cut and the central muon veto. (The 
muon veto was not applied in the forward region due to high chamber occupancy.) Muon 
bremsstrahlung backgrounds were reduced by requiring that the photon direction deduced 
from the finely divided EM calorimeter be consistent with the event vertex location. The 
photon impact parameter resolution was 10-20 cm. Additional suppression of the cosmic 
ray background was achieved by rejecting events with a muon-like energy deposition in the 
vicinity of the photon cluster. The residual background was estimated by applying the 
photon quality cuts to very clean samples of muon bremsstrahlung events. The estimated 
total muon background is 1.8 ± 0.6 events. 

The ly — > ez/ background was suppressed by the Ej, and ^q. cuts, set above the Jacobian 
peak for W ^ eu decays, and by the jet veto which decreased the smearing of the Jacobian 
peak due to associated jet production. It was further reduced by the photon quality cut (iv) 
which rejected photons with associated tracks or hits in the tracking chambers within roads 
pointing to the EM cluster. The rejection power of these cuts was estimated using Z ^ ee 
and W ^ ev samples with electrons reconstructed as photons due to the absence of a track. 
The residual background was estimated using the W —>■ eu sample with the cuts similar to 
the ones used for signal (except that a reconstructed track was required to match the EM 
cluster). The number of background events, obtained by applying track- and hit-counting 
rejection factors to this sample, was estimated to be 4.0 ± 0.8 events. 

The total muon and W —>■ eu background is 5.8 ± 1.0 events. Since the total jet-related 
background was less than the error on the dominant backgrounds, it was (conservatively) 
neglected when deriving the limits on the couplings. Table |I| summarizes the backgrounds. 

The acceptance of the D0 detector for the uwy final state was determined using the 
leading order event generator M to generate 4-vectors for the Z'j processes as a function 



of the coupling parameters. The 4-vectors were used as input to a fast detector simulation 
program which modeled the effects of the EM and missing transverse energy resolutions, 
interaction vertex spread, and offline efficiencies. The efficiencies were estimated primarily 
by using Z — ^ ee data. The trigger was fully efficient for Ej, > 40 GeV. The overall efficiency 
of the photon selection cuts was 0.57 ± 0.03 (0.64 ± 0.05) in CC (EC). The geometrical 
acceptance was 80% for the SM case and increased slightly for non-zero couplings. The 
MRSD— ' set of parton distribution functions (pdf) was used in the calculations. The 
uncertainty due to the choice of pdf (6%, determined by using different pdf choices) was 
included in the systematic error of the Monte Carlo calculation. We accounted for the effect 
of higher order QCD corrections by multiplying the rates by a constant factor k = 1.34 [Q. 
The jet veto efficiency was estimated to be 0.84 ± 0.02 by applying the veto requirement to 
the inclusive Z ^ ee data. The value of the /c-factor and the efficiency of the jet veto were 
shown to be consistent with the NLL Z'j Monte Carlo |T^ for the SM couplings. 



The expected signal for SM couplings is 1.8 ±0.2 ±0.1 events, where the first error is due 
to the uncertainty in the Monte Carlo modeling (13%), and the second is the uncertainty in 
the integrated luminosity calculation (5.4%). Our observed signal agrees within the errors 
with the background expectation plus the SM prediction. We verified this by simultaneously 
modifying the cuts on Ej. and ]^t to 35 GeV or 45 GeV; in both cases the observed number 
of events agreed well with the predictions. The Ej- spectrum of the candidate events along 
with the SM prediction and estimated background is shown in Fig. |l|. 

The most general Lorentz and gauge invariant ZV'~f vertex is described by four coupling 
parameters hY |T^. Combinations of the CP-conserving ( CP- violating) parameters h^ 
and h^ {hY and hY) correspond to the electric (magnetic) dipole and magnetic (electric) 
quadrupole transition moments of the ZV'j vertex. Non-zero (anomalous) values of the hY 
couplings result in an increase of the Z'-f production cross section, particularly for large 
Ej^ [§]• Partial wave unitarity of the general // -^ Z'-f process restricts the ZV'j couplings 
uniquely to their vanishing SM values at asymptotically high energies [0. Therefore, the 
coupling parameters must be modified by form-factors hY = hYo/{l + s/A^)", where s is 
the square of the invariant mass of the Zj system, A is the form-factor scale, and hYo are 
coupling values at the low energy limit [Q. We take n = 3 for hY^ and n = 4 for /i^4 [Q. 
This choice yields the same asymptotic energy behavior for all of the couplings. Unlike 
W'j production where form-factor effects do not play a crucial role, the A-dependent effects 
cannot be ignored in Z7 production at Tevatron energies. This is due to the higher power 
of s in the vertex function, a direct consequence of the additional Bose-Einstein symmetry 
of the ZVj vertices . 

To set limits on the anomalous couplings, a fit to the observed E^ spectrum of the photon 
with the Monte Carlo signal prediction plus estimated background was done. The fit was 
performed using a binned likelihood method |]lll, with Poisson statistics for the signal and 
Gaussian uncertainties for background, luminosity and efficiencies. Because the contribution 
of the anomalous couplings is concentrated in the high Ej, region, the differential distribution 
da/dEj, is more sensitive to the anomalous couplings than the total cross section (see inset 
in Fig. ^ and Ref. ^). To exploit the fact that anomalous coupling contributions lead to 
an excess of events with a high Et photon, a high-i^j' bin, with no events observed, was 



explicitly included in the fit [11 



The one- and two-degree of freedom (DOF) 95% CL limits on anomalous couplings in 



the (/ifo, /ifo) plane were obtained by cutting the hkehhood function 1.92 or 3.00 units below 
the maximum. A form-factor scale of A = 500 GeV was used in these calculations. The two- 
DOF limit contour (see Fig. |^) represents the correlated limit on a pair of couplings when 
both are allowed to vary independently. For models which predict a particular relationship 
between the couplings, thus eliminating one DOF, the appropriate point on the one-DOF 
limit contour should be used. The limit on one coupling when all others are fixed at the SM 
values is given by the intersection of this contour with the corresponding axis {axis limit). 
Since the (/ifo, hf^) pair is nearly uncorrelated with the other pairs [0] the correlated limits 
in the above plane are a good approximation of the global limits, i.e. limits independent of 
the values of other couplings. In what follows only axis limits are quoted; the correlated 
limits can be obtained from the figures. The 95% CL axis limits for the CP-conserving ZZ7 
and 2'77 couplings from this measurement are listed in Table |T[ Limits on a CP-violating 
pair of couplings are numerically the same as for the corresponding CP-conserving pair. 

Combined limits on anomalous couplings were also obtained based on this measurement 
and previous D0 results using Z -^ ee, fifi. Errors common to both analyses (e.g., 
luminosity, pdf uncertainties) were taken into account when combining the results. The 
combined 95% CL limits are about 10% tighter than for the neutrino channel alone and are 
listed in Table 0. 

Finally, the sensitivity of this measurement to the value of the form-factor scale A was 
studied. The value A = 500 GeV chosen above, is close to the sensitivity limit of the 
previous Tevatron measurements [|l],0. The sensitivity of the present measurement is higher 
and reaches A = 750 GeV for the neutrino channel alone (slightly higher for the combined 
ee + fiii + uu channels). The 95% CL limits obtained for A = 750 GeV are much tighter (see 
Table |Il[) and are shown in Fig. ^d. 

It is important to extend the experimental sensitivity to high values of the form-factor 
scale which is closely related to the scale of the new physics which can produce anomalous 
couplings. Our results show that the sensitivity of direct measurements of Z'j production 
to anomalous couplings grows with A. This fact makes such measurements complementary 
to the direct searches for new physics which have higher sensitivity at low scales. The limits 
on h^Q and /i^ couplings for A = 750 GeV obtained in this measurement are already close 
to expectations for anomalous couplings from new physics (see, e.g. [|14|) and are the most 
stringent limits on anomalous ZV'^ couplings currently available. 
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TABLES 
TABLE I. Summary of signal and backgrounds. 







CC 




EC 


Total 


Candidates 




3 




1 


4 


Muon background 
W ^ eu background 
jj + J7 background 


1.4 ±0.6 

2.2 ±0.6 

<0.4 




0.4 ±0.2 

1.8 ±0.6 

<0.2 


1.8 ±0.6 

4.0 ±0.8 

<0.6 


Total background: 




3.6 ±0.8 




2.2 ±0.6 


5.8 ±1.0 


SM signal prediction 


1.4 ±0.2 




0.4 ±0.1 


1.8 ±0.2 


TABLE IL 95% CL axis limits 
the CP-violating partners /i]^, h^Q 


on the CP-conserving anomalous couplin 
are numerically the same. 


gs h^Q, h^Q. Limits on 


Channel 


h!o = 


hi, = 


hlo = 


hl = o 


A = 500 GeV 




|/ifo| <0.87 
\hlo\ < 0.78 


|/ifol < 0.21 
|/ifol<0.19 


m^lK 0.90 
|/i^o| < 0.81 


\hJo\< 0.22 
|/ilol < 0.20 


A = 750 GeV 




|/ifo|<0.49 

\hl,\<o.u 


l/ifol < 0.07 
|/ifol < 0.06 


m^l < 0.50 
\h1o\ < 0.45 


\hJo\< 0.07 
|/ilol < 0.06 



FIGURES 



FIG. 1. Transverse energy spectrum of photons in the ll^xl events. The points show the data; 
the hatched curve is the SM signal prediction; the sohd hue is the sum of the SM signal prediction 
and the background, with the errors shown by the band. The inset shows the predicted da/dEj, 
folded with the efficiencies for SM and anomalous couplings. 



FIG. 2. Limits on the correlated CP-conserving anomalous ZZ7 coupling parameters /ifg and 
/ifo for (a) Z{uv)-f (A = 500 GeV) and (b) Z{ee + /i^u + vu)-i (A = 750 GeV). The solid ellipses 
represent 95% CL one- and two-DOF exclusion contours. The thin lines show unitarity bounds. 
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